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this report descritfe$' : &|id jcempares Quality Control regulations for selected 
Federal entitlement progra|4s. Programs examined include Aid to- Families with 
Dependent Children (^^fc^ Medicaid and % the -Supplemental Security Income Program 
run by the Department ^Health anoV Human Services (HHS), and the Food Stamp 
Program run by t t he ;bepjjr$ent ol Agriculture^ 



Each set of reguiat&ns dealing with Quality Control in the program is described 
according to several ^afacteristics. these characteristics and the definitions* are 
listeo* below: ' | 



• Description* The nature df tjte program and programmatic relationships 
„ among actof* (Federal, states, local) ■ 

' - r •;(:•;. vj' • ' ■ • ' '*••••".,» '•• 

• ^ QC Responsibilities: The portion of QC responsibility assayed to each 

"actor. ' ■•'ii'frM * ■ * 

■ . ' \0 ' ' • * •■ % •' ' 

• QCProce^^ss The manner in which QC is prescribed in the regulations. 

e, Standards* Performance levels identified in the regulation, such as 
acceptable error rate or payment tolerances. . ( 

• Measures:' Computation of indices of performance e.g„ computation of 
state error rate. 

yi • . * ■ ■■ * 

* m f 

9 Frequency of Measures: The frequency with which measures are computed 
or produced. . V 

w • Frequency of Reporting: The frequency with which measures must be 
reported to appropriate agencies, <• 

* Incentives: Positive .or negative inducements specified in the regulations 
. that encourage the reduction of error. . . * 

! * * ' * '• " 

. • • Other Elements! Other characteristics of the QC system. * / 

\ ... - . ■ \ 

A comparative matrix of QC systems follows these descriptions. 



DESCRIPTION OF APPROACHES f '\ 1 

This section describes the QC regulations jor selected programs according to the 
characteristics outlined in the Introduction. ~ 

2.1 AFDC QUAUTY CONTROL 

\ ■ ■ • 

2.1.1 Description 

• i „ • 

Aid to Families with Dependent. Children (AFDC) is an entitlement program that 
provides benefits to eligible families for child support in the form of cash payments. 
AFDC is, run by Health and Human Services (HHS) and administered by state agencies. 
HHS provides AFDC funding to states on a matching basis. Payments to states are 
determined by state AFDC expenditures. The Social Security Act of 1972 mandates 
that states shall operate an jgfeo ing Quality Control system. The regulations 
pertaining to QC in AFDC are Warned in 45 CFR, sections 205.40-44. 

2.1.2 QC Responsibilities • '< ' . 

* « 

2.1.2.1 Federal 

HHS has several basic responsibilities related to QC First, the agency develops' 
QC policies and procedures, Second, it establishes acceptable QC parameters. Third, 
it reviews agency perfoj^nance relative to the prescribed standards? and fodrth, it 
determines the fedej&lreimbufsement for state AFDC payments or Federal financial 
participation (Ff*P). Specifically, HHS performs the following QC functions! v 

• Specifies QC policies ancUprocedures and issues the QC Manual to which all 
state QC sjjSterns must adhere 

. • *- Monitors state error rates through periodic QC reports 

• Determine a national error rate from the state data 



• Reviews state error rates to determine if FFP should be reduced or 
increased; ' . 

■ • . *" V ' 

2JLZ3 States > 

* 

* State agencies must develop a state plan for a QC system and implement an 
ongoing QC system in accordance with the HHS policies and procedures prescribed in 
the QC Manual. States must continually monitor case error through sampling ami case 
review, and take corrective action on individual cases. States must also report error 
rates to HHS after the close of specified sampling periods. Specifically, states must: 

* ....■'< 

• Develop and maintain a QC plan and implement an ongoing QC system to 
'identify and correct j:ase errors . 



Develop corrective action* plans*f or reducing case error rates 
Periodically report dn error rates and corrective action- plans to HHS. 



2.i^L3 local Offices . • *. 

The regulations indicate no specific responsibility for* local offices of state 
agencies. V ■ »■ • * , 

2.1*3 QC Procedures f 

QC procedures are only generally discussed In "the regulations. The HHS QC 
Manual, the regulations indicate, contains specific QC procedures. The regulations 
mandate that Qg procedures shaik 

/ • Apply the prescribed sampling methods and schedules 

• Conduct field investigations, including a personal interview in ail cases, 
which fall within the sample of active cases,- and as necessary for cases in 
the negative case action sample 

* 

Provide the resources and methods necessary to analyze the findlngs-of the' 

.system,; , \ ■ \ , . • 

Take appropriation corrective action on improperly* authorized or denied 
assistance and on the causes of improper actions 

Assure access by , HHS staff to state and local records relating to public 
assistance recipients and to third parties. 



2.1.* Standards * "• 

* 

The regulations Identify several standards with regard to QC£ First, the 
regulations specify the "national error rate," which serves as a baseline in determining 
acceptable state /error rates and is defined in legislation as ft percent. Second the 
regulations establish an. improvement rate of one third over the three year transition 
period for states that have errpr rates in excess of the national error rate. ' 
: • '. ' r *• . *• '-' •• . ' '.' * m . 

In addition, the regulations set error rate standards for filing corrective, action * 
plans. These standards are 3 percent for payments to ineligible persons and 5 percent • 
for Under or overpayment. The regulations also define $5 as 1 the standard for 
individual cases of under or overpayments. V 

2JL5 Measure , . 

.•a. The only measure^ specified in the regulations is state '^payment error rate," 
which is defined as "the dollar amount of incorrect payments a state has made 
expressed as a percentage of the stated total payments." ' 



2.1.6 Frequency of Measure 



t 

The regulations imply that measurement is ongoing, noi^thstandirtg existing 
state plans. HHS has established tteo 6^ month sampling periods: April 1 through 
September 30 aha* Oct I through March 31. *'.*'-'« 



t 2.1.7 Frequency of Reporting 1 

States are reguirecf to file error reports with.HHS within '60 days di the close of 
Jf each sampling period and corrective action plans within 9ff>days. % ' , , ' 



2.1:8 Incentives 



the HHS QC regulations "provide for both positive and negative incentives? 
. incentives are tied to error rates. The regulations mandate lhat states which are not . 
either at or below the national error rate or their target error rates,- will have the FFP 



t 
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reduced by the dollar difference between the state error rate and the national error 
rate. States can appeal to HHS, within 45 days, any reduction in^FP. Such appeals 
are heard by the Grant Appeals Board. "" '' 



Conversely, states receive increased FFPs for error rates below 4 percent* 
These states receive an additional amount equal to 10 percent of the Federal share of 
money s&ved for each one-half percent below percent to a maximum of 50 percent. 



2.1.9 Other Elements 



. The AFDC QC also calls for corrective action plans that are developed by the 
states and submitted to HHS. These plans identify means for reducing case error rates 
for ineligibility, overpayments, and underpayments. 



24 ' SSI QUALITY toblTRQL 
Z2+1 Description x , 



r 



Supplemental Security Income (SSI) is an entitlement program that provides 
"benefits in the iorr/i of cash payment to the aged, blind, and disabled. Legislation 
passed in 1972 created a national SSI program ^hat centralized an&consolidated within 
the Social .Security Administration various state programs, and standardised payments 
accross 6ie country. States are* free to supplement such payments. In 17 states, SSA 
(HHS) administers both the Federal SSI and state supplementary payments. SSA bills 
states for these supplementary payments. / „.''.•■ 

I 

' .' ■ , \ • . 

SSA has two QC systems. The larger and more* complex is the Agency's internal 
system. This system is not prescribed through regulation since it is an internal system. 
The second QC system, one which is treated in regulation binder 20 CFR, section 
41 6.2QS6* deals with Federal administration of state supplementation funds. This QC 
system monitors- the accuracy of , Federal actions with regard to 'Supplementary 
payments. SSA assumes liabaity for erroneous supplementary payments and repays 
states for such errors. SSA is not required .by |aw to maintain or conduct such a 
system, but does so/voluntarily. ' * 



2^2 QC Responsibilities " ' 
2*234 Federal 



SSA has the pri^apf responsibility f or specifying and running the QC system. 
The Agency has outlined toe specific 'procedures fin the regulations. Administratively, 
the Agency also conducts the QC reviews. Specif ically, SSA': • . ' * 

* ■ " • .: '* . •»«'•'• 

■ t 

„ ■ »■ y * 

Specifies and maintains the QC system 
Periodically conducts QC reviews ■ * , 
Determines Federal liability to states for overpayments 
Reimburses states for Federal financial liability (FFL) 

• - ♦ * 

Attempts to recover overpayments or payments to ineligibile individuals 

Adjusts QC error rate findings and payments to^tate if reviews indicate a 
? higher error rate. • , . 

2.2 , 2 . 2 States . ; - 

* •".*.■ * ' 

States, under their agreement with "SSA which autf*wi?es the Agency to 
administer state supplementary assistance payments, may conduct its own review of 
cases that SSA reviews. Specifically* states may: > ^ 

• Select a subsampie of SSA identified cases for review ' 
• *• Determine the error^ate independent of the SSA review 

• Inform SSA of Its error rate findings . - 

• '* 

• Request adjustment of FFL. 



( 



2*2*2*> Local Offices 



Local office responsibilities are not mentioned in the regulations. 



2^3 Qcf Procedures 



. In each of the 17 states in which SSA administers mandatory and supplementary 

(state) paxments, the Agency selects and reviews a vaUd sample of feleVani cases. 

From, this sample, SSA computes an error rateior state supplemental payment^ by 

, -comparing- the appropriate eligibility with the 'actual paymejits^ ; ' . ' ' ■'"*> 

;. v , „ ^ 0 . ■ - ■ » ,-■ * ' 

Standards *" '•• ' ; * ' -V %, • ; V 

• h ' ■ "" r- - ; . " 

>** - . , * • > 

'* - * 1 ' «■ 

■ . * The SSA estabUshes in the regulations one imjor standi lor the QC system, 'the 
national error rate. This is set at # percent. • '•'•> ? <■ 

2^.5 Measures \ ; 

Two. measures are defined in the regulations. First is the error rate measure 
and, second, the Federal financial liability' (FFT). «**'•'.' 

The error rate lieasure Is the sup of ali incorrect state supplementary ^yments 
to sample cases injfce sampling period divided By the total supplementary payments to 
cases during the period. » 

, The FFL is computed by multiplying the error rate by the total amount of 
Federally administered state supplementary payments in the state within the 6 month 
period and subtracting 4 percent from the total amount of Federally administered 
supplementary payments. 

ZZfc Frequency of Measures - • ' 

- . " . ' ■ •• v ' '- ■ . 

The measures cited above are computed for 6 month- periods, beginning in April 
jff*. ° ctober - States must conduct their.own. reviews at the same time as the SSA 

reviews. * ' 

» • • ■ „ .. . . 

»■■•.%-•.. * . 

■ s \ 

Frequency of Reporting . " 



The results of the measures are reported every 6 months. " 



■J 



; S5A assumes j|idl^tsr. i( .<PPL> ,for/^ "'■amouftt etjiial to ' the incorrect state 
,• supplementary payments^ m states in vwhicfrthe 

^^,^ en ^ a #» li ^^efs i>0*h; ritonit<#riic^; and ^lementa^' : p,ay.m€«t8..'' ; . • . 

•■ ' . ' :v ' ' 1 1 ' •'. ■ 1 '»/ ' . ... 

H . ^Oob sTAMp F^PR*iAN<*E REPORTING SYSTEM QUAUTY CONTROL 
23.1 Description . TV ' 



T - The Hoo^ Stamp program is an .entitlement program; providing assistance to 

■ '•?^!^ il,fiE ^?** i ^. * **** ^rm of coupon redeemable W food. ' The 

■ program is -run by the Food and Nutrition Service (FNS) of the US, Department of 
Agffic^^e/^lthou^ benefits are funded exclusively by the Federal government; the 
program is administered ^through state agencies* The Department pi Agriculture 
reimburses states for. 50 percent of the costs incurred in administering-the program in 
the state. - : "\ . ~ . ' ' ".*« 



to order to reduce administrative error in sta*s adnw^tetion or the Food Stamp 
program, the 1 977 Food Stamp Act mandated that states condM an ongoing system of 
monitoring an* improving program-^admirustration. The FNS ihipleniertted <juality ; 
control procedures through the Performance Reporting System (PRS). This/system has 
two componeirt& * Wa^enTent Evaluation and Quality Control reviews. This analysis - 
focuses mainly on the C^Bty Control review although/the system is an integrated one. 
The regufetions also tie Federal reJn^>ursement of states' administrative/costs to the 
error rates. ' The regulations pertaining to the PRS and quality control aJ contained in 
7 CFRpart.275. \ , . . 7 



X 

/ 



23% QC Responsibilities 
23^.1 Federal 



The FNS has several responsibilities for the Food Stamp qualiW control. First, * 
FNS specifies the characteristics and procedures of the PRS thrbugh regulations^ 
These regulations Outline in detail ail facets of the PRS, including /responsibility ' and 



^ ' 8 

• 11 



ifrocedures for general administration, management evaluation, quaUty control,' data 
analysis and evaluation, and reporting on program performance. 



/ Second, the. FNS monitors agency performance through various state 
reports. FNS monitors stated activity on three levels: compliance with program 
.; regumionsj appropriate review procedures including sampling techmljues; and review 
> findings, which measure state agency performance. 

, '■ * <* 

p ' * * • 

Third, the FNS, if necessary, o*etermines if the state is eligible for an increase in 
the Federal share of administration costs or is liable for payment in excess of the 
error rate goals. Fourth, FNS approves ai* corrective action plans developed by state 
• agencies 'to reduce error." . » 

■>'.' • ' . '.. - ' . . 

States * 




States are responsible for establishing a* continuing PRS to monitor program 
. administration and oj*ration> Specifically, the state system-should includes 

•• - coile^tion through management. evaluation (ME) reviews and quality 

control (QQ reviews ■ 7 

. .. .;■ .. ' _ ■ . _ - ^ . V " ; ' ' 

• Analysis and evaluation of data from all sources*^ . • . 

• Corrective action planning ' . ~ i\ 

• Corrective action implementation andmponitoring ' ' 

• Reporting to FNS'on program pecfbrmance. . • 

. . *» 

' Sta#es must also appoint a fuii*time stafl member at the state level to 
coordinate the, PRS and ensure implementation of .corrective action. States must also 
employ "sufficient skterlevel staf/ to perform all aspects of the (PRS>. .. .« 

23.23 * Local\Of£ice$ 

The regulations dor not mandate a role for locat off^ and local program staff 
are pf ohibited from Conducting Mfe or_QC reviews without prior FN*5 approval. 



233 QC Procedures 

. . * v . . ..... . ; .. ... 1 . 

■» . 

Quality control reviews measure* validity , of food stamp cases by reviewing 
' sample cases against, the Food Stamp Program standards established in the FooTStamp 
Act and the reguiations„ as specilied in each state's FNS-approved manual The PRS 
QC regulations require samplings specified number ^of active- (those receiving 
benefits) and negative (those denied benefits) ca^ verification of household 
circumstances that relate to. eligibility tl^rough interviews and checking collateral 
sources, determination of appropriate level of benefits, and cbmparisort with benefits 
received. , 

The regulations require that state! analyze the findings' to determine the 
incidence and dollar amounts of errors to determine the state's cumulative allotment 
error rate and eligibility for enhanced funding in accordance with the Fpod Stamp Act 
o*f 1977, and plan corrective action to reduce excessive levels of errors when 
cumulative allotment error rates of 5 percent of more are reported. * 

' ' the regulation -afecftte^ sample size, 

sample selection and sample case review completion. - 

Similarly, the regulations specify in detail the procedures for' review of active 
cases. These include* • . 

• A case record review ' 
. • An interview with the participant ' • 

• Verification of information, using >secondary sources when necessary 

■ « - " » , .... J 

• A determination of the presence of any variances 

• A determination of eligibility and correctness of issuance 

• determination of the number of administratkm deficiencies. 

■ x .. • . .• 

• ■ ' \. ■ 

For negative a, ^ 



23»* Standards '"„■ 
/ . • . ■ ' . • ■*•-.* -' 

...... * 1 ' • 

- Jt . . . '; 

FNS establishes several standards in the regulations. First, the regulations- 
specify.5 percent as tte national standard for error rates. In addition, the regulations 
*estaMish an algorithm for establishing error rate goals for states above the national 

standard. * , -y * 

.»••.-... - •> . o • , 

■ . ■ ■■ • ' " • • • . * . . ' ■ ' - * ' ■ , , • 

■ • ' V ' 

Because of the detailed nature of the regulations, many standard for sampling 
and case review are established, including a 95 percent completion rate for case 
review and a $5 error tolerance for benefits. ' 

. • ■ ■ . . • ' • ■ - " * ... . 

«• " . '• - .... 

2*3.5 Measures •/ 

The regulations establish several measures for the Food Stamp PRS (JC system. 
First and most important is the cumulative allotment error rate, which is a cumulative 
index of several types of error. . This is computed by summing the dollar value of 
allotments underissued or ^overissued to sample recipients, including ineligible casesv 

In addition, the regulations establish active and negative case error rates. Both ^ 
are computed by dividing the number of sampte QC cases which contain one or more of 
several types of error by the total number of cases in the QC sample. The result is 
expressed as a proportion* ~ ' % . 

t 

23.6 Frequency of Measures 

The quality control program samples cases in six month periods. The^setection of 
individual cases for QC reviews are made separately each month during the period. 

23.7 Frequency of Reporting * " 

.' * - * 

State agencies report QC findings on a semi-annu£U basis. 

23.8 Incentives " " 

The Food Stamp PRS QC system contains both positiyfe and negative incentives, 
which are tied to the cumulative allotment error rates. States with an error rate 

• ' ' " ' ' ' ii . '< ^ 




below S percent are eligible |or a 60 percent Federally funded share of administrative 
costs; a 65 percent share is provided to states with an error rate of 5 percent or below. 
States above the 8 percent rate thaV reduce error rates by' 25 percent or more in a 
year are entitled a 55 percent Federally funded share of administrative costs. 

• t .. : . ; ■• ., 

States failing to meet error rates goals must repay FNS for the dollar value of 
the difference between target error rate and' the actual error rate , for. a six month 
sampling period. • .• * • 

' p - ~ 

• 23S Other Elements 

the Foold Stamp PRS QC system is part of a larger management and reporting 
system* The regulations indicate not only a heavy emphasis on measurement of 
T>erformance and error rates, but also corrective actions^ States are required to file 
corrective action plans that detail the means by which administrative problems and 
error rates will be reduced. • . ' ' \- V • 

MEDICAID QUALITY CONTROL 

7 : .• - . . ' • " ■>:■/';. 

2££l Description 

Medicaid is an entitlement program that provides benefits '$0 eligible individuals 
in the form of payments for medical services. Medicaid is run by the Health Care 
Financing Administration of the Department of Health and Hunfen Services and is 
administered by state agencies, HHS provides medicaid funding to states on a 
matching basis. These payments are known as the Federal financial participation 
(FFP) and are provided on the basis of allowable state Medicaid expenditures. The QC 
system used in the Medicaid program is similar to the AFDC QC system. The 
regulations pertaining to Medicaid QC are contained in *2 CFR, sections $31,800-80$. 



2.^.2 QC Responsibilities 

. Federal " ^ 



HHS has several basic res^kxwibiiities related to Medicaid QC, First, the agency 
develops QC policies and procedures. Second, it establishes acceptable QC 



parameters.. Third, it reviews agency performance relative to* these standards and 
fourth, determines the Federal reimbursement for state AEDC payments or. Federal 
financial pa/ticipation (FFP). Specifically, feHS performs the following QC functions: 

• Specif iesjjc policies and procedures and issues the QC Manual to which all 
states Q^systems must adhere ; { % 

■ • Monitors state error rates through periodic QC reports _ 

• Reviews .state error* rates to determine if FFP should be reduced for 
unacceptable error levels or if FFP should be increased for state error rate 
below the national standard. \ ♦ • . , 

• ; . ■ • . . . « # - ' , ■ 

Z^Z2 States 

State agencie^ must develop a s&te > plan for a QQ system and implement an 
ongoing QC system in accordance with the HHS policies and procedures prescribed in 
the QC Manual. States must continually monitor case error through sampling and case 
review, and take corrective action on individual cases* States must also report error 
rates to HHS after the close of specified, sampling periods. Specifically, stated must: 

• Develop and maintain a QC plan and implement an ongoing QC system to 
identify and correct esse errors -** ' • -v. * 

• Develop corrective action plans for reducing case irror rates 

• Periodically report on error rates and corrective action plans to HH$. 

i ^ a 

\ 

2.4.23 local Offices 



V 



The regulations indicate no specif ^role for local offices of state agencies. 

* 

2^3 QC Procedures 

j QC procedures are generally discussed in the regulations. The HHS QC Manual, 
the regulations indicate, contains specific procedures, the regulations mandate that 
states shall? i - 



• Operate the MQC system in accordance with the policies, sampling 
methodology, review procedures, and reporting forms and requirements 
specified in Medicaid quality control manuals issued by HCFA ' 




• Select statistical samples of ia^th active and negative case actions 
Review each case in the sample to identify eligibility errors v, 

^ ms ,P«^ng to each active case to identify erroneo 
payments resulting from — /> 

' ; - ■ Ineligibility " V 

* Recipient understated or overstated liabilitv 

Third-party liabUity >' » . 

•• bairns processing errors ' * v v. 

- * / '^SS^^ } ' ini ^ i ^ * °f dCr t0 VttUy ^Uitir information, 

Penjbnai interviews foreach case in the active case sample 
v Jersotal interviews for cases in the negative case action sample, to 
the extent necessary to verify erroneous eligibility determinations 

' . • . •• * 

2.*A Standards ./•■■.• 

, • . ' ' , v ; , ' ft ' . • . 

The regulations establish several star^ measure 
is the "national error rate," which serves as a baseline in acceptable state error rates. 
This is defined in legislation as * percent. Second, the regulations establish an 
improvement rateof one third Over a three year transition period for states that have 
error rates in excess of the national error rate. The regulations also define the error 
standard as any amount greater than the allowable reimbursement level for a specific 
service. • 

Measures ^ 

Two measures are specified in the regulations. The first, the annual state- 
payment error rate, which is defined as the sum of the weighted payment error rates 1 
for the two 6-month review periods. Weighting is established as a percentage of total 
\ annual payments that occur in each she month period. 

The regulations state that the second measure, the state payment error rate, 
which is computed as part of the QC findings, will be determined for each annual 
assessment period "in accordance with instructions issued by HCFA" (section 432.802). 



2.4.6 Frequency of Measures 



• • - * „ 

The regulations imply that measurement is ongoing, HHS has established two 6- 

month sampling periods: (April 1 thourgkiSeptember 30 and October 1 through March 

31). State error rates are, however, computed* on an anriuai basis. ^ 



riequencjfti Reporting 



The agency must submit reports to HHS in the form and at the time specif ied, 
including* . 

. . I ..... , " 

f ' 

• A description of the State's sampling plan for active cases and negative 
cases* . ; ; , . * • 

• A monthly report on eligibility case reviews completed during the month 
for all cases jn the active case sample for that month and selected cases 
from the negative case sample for that month 

• A monthly report on payment reviews completed during the month for 
- cases in the active case sample (States must wait 5 months after each 

sample month before accumulating claims paid for each case — through the 
fourth month following the sample month) ' 

• A summary report on eligibility bindings and payment error findings for all 
cases in the 6*month sample, to be submitted by' May 31 of each year for 
the previous April - September sampling period, and by November 30 for 
the October - March sampUng period 

• Other data and reports that the Administrator requests. 
Incentives ' . \ ' 

The HH^ Medicaid *QC regulations provide for penalties in the form of FFP - 
reductions tied to annual state payment error rates.' The regulations mandate that 
states that are above the national payment error rate will have the FFP reduced bv 
the, dollar amount equal to the difference between the national and the annual state 
payment error rates. States can appeal the reduction by demonstrating that inability 
to reduce error was due to factors beyond its control. ' 




ts 



Medicaid QC also calls for corrective action plans that are developed by the 
states and submitted to HHS. these plans identify means for reducing case error rates 
for ineligibility or overpayments*: " r 



The agency must: 

• Take action to correct any Eligibility, third-party* liability, claims 
processing, or^egatjve case, action errors found in the sample cases 

♦" Take administrative action to prevent or reduce the incideiice of those 
• errors' •' / ' *: 

• By July 31 each year, submit to the Administrator a report on its error 
analysis and a corrective action plan. ■ < .' 

- . * . ■ - ' v • - 

Z3 MATRIX ' 

The following matrix compares the characteristics of quality control regulations 
for the four entitlement programs 



CHARACTERISTICS OP QC REGULATIONS FOR SEI^CTED'EimTlJEIIElSff PROGRAMS 
^ PROGRAM ^ « 4 



AFDC 



Rim by HHSf administered 
by states, 

Stales relmbursed'on a . 
matching basis lor allow- 
able cash payments 



SSI 



Run by SSA/HHS 
Program aba administers 
state supplementary payments 
SSA reimburses states for 
erroneous payments above the 
national error rate 



Food Stands 



Mm by the FNS/Department 
of Agriculture* administered 
by state agencies 
Department reimburses states 
for 50 percent of program 
administrative costs 
QC Is part op% Performance 
Review System <PRS> 



Medicaid 



Run by HCFAA#Bj 
administered by states 
HHS reimburses states 
on a matching basts for 
allowable medical 
services 



Establishes Qfc policies 
and procedures and publishes 
QC Manual 

Establishes QC system para- 
meters ,. . 
Determines Feo^l financial 
participation (FFP) adjustments 



• Develops state QC plans 

• Implements an ongoing QC , 
/system 

m Develops corrective action 
plans 

• Periodically reports error 
rates and corrective action 
plans to HHS 



No responsibility specified 
in regulations 



• Has primary responsibility for # 
conducting voluntary QC tor _ 
state supplementary funds 

0 Determines error rates 

• Reimburses states for erro- # 
neous supplementary payments 

Iff excess of national error * 
rate 

• Attempt to recover overpay^ 
merits f 

• ' May conduct its review of : 

a sUbsanyle of cases selected 
by SSA for QC review 



No responsibility specified 
in regulations 



Specifies characteristics and . 
procedure! for all facets of 
PRS through detailed reguia- • « 

tion* ; ■ x • • ■ ■ ; 

Monitors state agency perform- 
ance through state PRS reports 
Determines administrative cost 
adjustment and state overpay-, 
ment liability f 



Responsible for data collec- 
tion through management 
evaluation (ME) reviews and 
**«ty &mtrof (QC* review** 
analysis and evaluation of 
data from all sources* cor- 
rective action planning* cor- 
rective action implementation 
and monitoring* and reporUr^j 
to FNS on program 
> 

No responsibilities specified 
in regulations 




itablishesQC polities 
1 procedure! and 
lUhesQC Medicaid 
If 

blishes QC system 
rameters I 
tterminei Federal . 
financial participation 
(FFP) adjustments 



Develops state QC plans 
Implements an ongoing 
QC system 
De^etops corrective 
action plans 
ParlodtaUty reports er- 
ror rates and corrective 
action plans to HHS 



No responsibility speci- 
fied In regulations 



BEST COPY AVAILABLE 



♦ States must follow QC pro- 
cedures outlined In HHS/AFOC 
QC Manual 

* Regulations mandate that 
states* 

- apply the prescribed 
sampling methods and 

^schedules 

- conduct | leldj tnvestjga- 
tions* ine hiding a personal 
interview in al I cases 
which fail within the sam- 

. pie of active cases, and as 
necessary for cases Sji the 
Vtegativt case action sample 

- provide the resources and , 
methods necessary to 
analyze the findings of the 
system 

<* take appropriate corrective 
action on Improperly author- 
ized or Rented assistance 
and on the causes of irnpr op- 

- assure access by fttiS staff 
to state aril tocaltccord* 

^ relating^ public assis- 
' tance, to fetiplcnts, and to 
third parties 



* 

a. SS A select! and reviews • 
valid sample ot relevant 
■ cases .- 

# Computes error rates hy 
comparing appropriate p$- 
fttents with actual payments 



Food Stamps 

QC procedures are specified 
in detail In the regulations 
and include* 

- sampling procedure*, 
including minimum sample 

i sixes 

- case review procedures, 
Including a case record 
review* art interview with 

" ^T^etpahf j Tverlfl- ; - 
cation of information* 
using secondary sources 
when necessary fa deter- 
mination of the presence 
of any variances and 
coding and analysis of 
the variances, if applica- 
ble* a deter minattonof 
eligibility and correct- 
ness ol basis of issuance* 
* and a determination of 

the number of adminlstra- 
five deficiencies • 

- completion rate for ail 
" y selected cases ^ 



Medicaid 



Leglsiatlbn defines "national 
error rate*? at *% 
Spittles an improvement rate 
for reducing state error at 
one third per yew during the 
three year transition period 
Specifies error levels above 
which corrective action plans 
are required to be submitted 
to HHS 0% per payments to 
ineligible!* 5% for under or 
overpayments) 

Specifies $ 5 as error tolerance 



The single standard established 
In the regulations U the na- 
tional error rate at #% 



Regulations mandate 
that states* 
- operate the <jC ^ sys- 
tem in accordance 
with the policies, 
sampling methodology, 
review procedures, 
and reporting forms 
and requirem ent 5 -s pe- 



m The regulations specify a 5% 
. national standard for error 
* rates 

• Specifies a 95% cm review 
completion rate error level 

• Specifies $5 error tolerance 



BEST COPY 



r 

AWMLA&E 



~ cSlieainafe^aia^ 
<J*Uty control man- 
uals issued by HCFA 
*- select statistical , 
samples of both 
active and negative 
case actions 

- review each case In 
the sample to identi- 
fy eligibility**™* 

- review any claims per- 
taining to each active 
case to identify all 
erroneous payments 

- verify eflgtbUfty infor- 
mation by conducting ' 
field investigations, ~ 
including* 

- personal interviews 
for each case in the 
active case sample 

- personal Interviews 

" to* cases in the neg- 
ative case action 
sample, to the ex- 
tent necessary to * 
verify erroneous 
eligibility deter- 
minations 

- use 6-month sampling 
periods, from April 
through September 
and from October 

* through March 

a \eglsiation defines "na- 
tions! error rate* as 4% 

• Specifies an Improve- 
ment rate tor reducing 
state error at one third < 
per year4uring the three 
year transition period 

• Specifies any amount 
above allowable relm- - 
bursement level as an 

_ error 



PROGRAM 



AFDC 

Payment error rate is the dol- 
lar amount of Incorrect pay- 
ments a state has made 4s a 
percentage of the stated 
total payments 



• Regulations Imply Inquiry 
tajnplirig during^ wo 6 month 
sampling per U*s beginning 
in April and October > * 



States are'required to report 

E findings within 60 days of 
close of each sample period 
:es are requited to fife 
corrective action plan*, if 
necessary, within y& days of 
the close of the sampling per- 
iod 



SSf _ 

Error rate Is computed by sum- < 
mlng all incorrect state sup- 
plementing payments ln*he sam- 
ple divided by the total sup- , 
plementlng payments tocases 1 
FFL is the quotient of the 
error rate times toUl Feder- 
ally administered supplement 
tary payments in the state 

Measures for supplementary 1 
payment error ate computed 
for each 6-month sampling 
period -.■ T 
States must conduct reviews 
at the same time 

Error rates and FFL are re- 
ported after each 6 month sam- 
pling period 



jFjood Stamp s 

Regulations specify a cumuia^ e 
tlve allotment erw rate, 
which is the dollar value sum 
of all erroneous allotments 
Ca$e*rror is the proportion 
of'sarnpte cases In error 



• QC samples cover 6~month 
periods 

• Cases are reviewed continu- 
ously during these periods 



♦ Agencies report semi-annually a 



/ 



0 
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MgBcajd 

Annual state payment 
error rate is the sum of 
weighted payment er- 
rors for each of the sam- 
ple periods 

Payment error Is deter- 
mined in accordance 
with the Instruction 
Issued by MCFA . 

Regulation* imply in- 
quiry sampling ^rtng 
two 6 month sampling 
periods beginning In % 
April and Octobfer 



The regulations state 
that the agency must 
submit reports to the 
Administrator, in the 
form and at the time 
specified by him, 
including* 

- a description of the > 
state's sampling plan 
for active cases and 

, negative cases 

- a monthly report on 
eligibility case re- - 
Views completed dur- 
ing the month 

- a montMy report on 
payment reviews com- 
pleted during the 
month for cases in the 

■ ■ -case sample- 

- a summary report on 
eligibility findings and 
payment error findings 
for alt cases in the* 
month sample, to be 
submitted by May 31 
of each year for the 
previous April-Sep- 
tember sampling per- 
iod, and by November 
50 for the October- 
JjfartN stmptltqg period 



\ 



c, 1 



AFP 



a Negative? 

- stales are responsible for 
the amount of erroneous v 
payments above the malt tonal 
error rate 

- FFP k reduced to reflect 
such amounts. 

a Positives 

* states receive Increased 
FFP let error rates Mow 
the national error rate 

- amounts equalipaddi- 
tionat of ft* Federal 
money gained up %o 50% 
for each half percent 
telow t% . 

a AFOC QC calls for corrective 
action plans as a response 
to error rate determination 

a An appeal of a "disallowance* 
or reduction erf FFP is pro- 
vided In the regulations 



v ^ ssi» ; * ' 

Negative* 

4;^A assume* UaWllty (FFL) 
fc^ ail erroneous payments 
^excess of the k% of 
total payments 



i, 



Food Stamps 

Negativei 
states are liable tor the 
arocKmtof erroneous pay- 
ments in excess of of 
total payments 



a Positives 

- sutes aretiigibte to 
receive an Increased 
share of Federally funded 
administrative costs for 
error rates below g% and 
5% and for decreasing error 
rate 25% within a year 



a Food stamps QC la par t of an 
Integrated PRS that provides 
a comprehensive and continued 
evaluation of management, 
regulatory compliance, error 
rates, and planned corrective 
*ctk*l 



Medicaid 
Negatives 

- sutes are responsible 
for the amount of 
erroneous pay frtcnta 
above the national 
error rate 

- FFP Is reduced to re- 
flect such amounts 



Medicaid QC call* for 
corrective action plana 
as a response to error 
rate determination 
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CONCLUSIONS AND IMPLICATIONS PQR «- ' h 
ED TITLE IV QUALITY CONTROL REGULATIONS A 

■ .' ' ■ ,*''*■ 
*< ..'".*.•♦ ' r * . ■ ■ # 

3.1 CONCLUSIONS . / 

The foregoing sections of this report examine the entitlement program 
regulations issued by several departments and agencies to. determine the approach 
taken to quality control (QO through regulations. From this analysis several 
Conclusions can be drawn. These conclusions deal with both the configuration of 
/♦quality control procedures and the approach to the regulations themselves* Each of . 
these has implications for Jhe general approach to quality -control regulations which 
might be taken by ED. 

First, the present analysis suggests that the structure of the deliver/ system is a 
"critical factor in determining the regulatory ' approach to QC taken by Federal 
agencies. Each set of QC regulations reviewed deals almost exclusively with states 
and specifies no role for local agencies or offices. The delivery system '.Jm centralized 
/ at the point of federal/state contact, which has mafor structural and functional 
implications for Title IV QC. 

: . . %• . - . ■ - " '• 

• . ' ; .. . . . . • . • • • / 

HHS, in the AFDC and Medicaid programs, uses £n approach in which the. Agency 
prescribes to state agencies QC policies, procedures and system parameters. State 
agencies develop and implement Quality control plans and procedures which measure 
and report program error Vates. HHS then reviews and approves (or disapproves) QC 
-pkns. ^e 4^ederal agency ^then imputes the Federal financial participation (FFP) 
and thai: penalizes or rewards states on the^basis of error rates. It also approves (or 
disapproves) any needed corrective action plans. 

- SSi, administered by SSA Within HHS, has similar QC procedures, except that 
SSA conducts the actual QC for state supplementary payments, and reports to and 
pays states if SSA error rates are above the national standard.- • 



The FNS utilizes a different approach within a similar administration structure. 
FNS has established a far more comprehensive Performance Reporting System (PRS) 
of which quaUty control is a single facet. The PRS requires that ^states report 
management and other evaluations as' well as submit corrective action plans. 

. Second, all regulations mandate the ^ commutation and 

reporting of error rates, hut also the development and implementation of corrective 
action plans. These plans emphasize administrative improvement by states and 
identify procedures for reducing error. FN$ requires approval of corrective action 
■ plans. . " ■ V- 

' • ' > • '' " ; ■ • * ■ * 

* *• t 

\ . • •• *''.■'•"■-'. • *> '" ■ • ■ 

Third, standard^ measures and fre«|uenc> of computufe and.reporting measures 
are fairly consistent across programs. Legislation specifies a C percent err^r rate as 
the national standard for the HHS programs and FNS uses a simUar standard. " 
Measures vaiy somewhat due to the differences among programs. Frequency of 
computing and reporting measures are cons^tently semi-annual. All programs include 
negative action cases (those denied benefits) in sampling and measures. 

Fourth* most regulations identify both positive and negative incentives? only 
Medicaid does not utUke positive incentives for ste^ tn all but SSI, states are liable 
*4br erroneous payments about an amount equal to the NatiohJ ^fcdard; the opposite 
is true for SSI, in which SSA administers state supplement^ payments* Positive 
incentives are generally similar* rewarding states thjt are beMf 'the national standard 
error fates, although the mechanisms differ. Through 'fji matching funding 
arrangement, as in AFDC, these incentives are tied to ovelnjatching the state 
contribution. For Food Stamps, in which FN$ support the entire program, FNS 
increases administrative allowances as ah incentive. w * 

' % ■ *»' f '■ 

Last* the character of the regulations themselves differ across agencies. HHS 

r ^ gula ! ions .'. m ^.;?^.^...^.- br f!?^ .I?!* .^u*itlom„ reference the respective 
quality control hantooota for detailed procedures 4nd policies. Conversely, FNS uses 
the regulation to provide ail details for state quality control systems. 



3.2 IMPLICATIONS FOR, TITLE IV QC REGULATIONS 

These conclusions drawn from an analysis of QG regulations for Federal 
entitlement programs have several implications regarding the regulatory approach to 
, QC which might be taken by ED. Firsts and perhaps foremost,' the structure 1 of the 
student aid delivery system, and the nature of the relationship of ED and education 
institutions participating in Title IV programs, require a different approach than those 

used in Federal programs reviewed above. * 

■ : ••• • * A • 

^ . \* 

3^.1 ResponsibiUties 

* Most germaine is the fact that the Title IV oeUvery system is considerably more 
decentralized than the other Federal programs reviewed in this analysis. The absence 
of states as an intervening administrative layer renders infeasible for Title IV purposes 
some of the characteristics of the regulatory approi&i used in these other entitlement 
programs. While ED would clearly assume responsibility for Equality assurance similar 
to those assumed other Federal agencies, primary QC responsibmties must rest at 
the local level with the Institutions. Although this' fact is self-evident, it contrasts 
with the structure of existing QC procedures and has implications for ED*s ability to 
execute and mpnitor Title IV program QC These impUcation will be discussed below. 

3.2^2 Procedures 

In light of ED's approach to validation and verification, it seems appropriate and 
consistent that £D specify general QC requirement and procedures in regulations 
while providing a more detailed set of procedures in a Quality Control Manual. This is 
similar to the approach used by HHS in the AFDC program, but significantly differs 
from the FNS/Food Stamp and HHS/Medicaid approach of providing detailed 
procedures directly in regulations. It is clearly advantageous to utilize a QC Manual 
and not be required to make constant regulatory revisions for routine and minor, 
changes in procedures. Using the HKSMPDC approach, ED's QC regulations would 
require that institutions: 

. • Apply the prescribed sampling methods and schedules 

• Conduct appropriate and prescribed review of all cases which fall within 
« . -the sample of active casein and as necessary for cases, in the negative 
action sample 



• ^ t ^ C the re f )urces methods necessary to analyze the findings of the 

t Take appropriate corrective action I on improperly authorized or denied aid 
and on the causes of improper actions 

• Assure access by ED staff to records relating to QC actions. - 

V The QC Manual would prescribe specifl^rocedures for meeting the general 
. regula^ry ^requirements. In light of the dive^ity of institutions^ alio wing some 
flexibility to use procedures appropriate to the institution's capabilities and structure 
#. would be beneficial. . - 

■ " i « • * 

.......... 1 , ' ■ • " 

The requirement of developing and implementing corrective action plans, 
essential parts of QC in most regulations reviewed in this report, should also be a 
component of ED% approac^ to institutional QC. ED review and-approval of such 
plans, however, as included in the FNS/Food Stamps 'regulations but not in the HHS 
regulations, is unrealistic in light of the number of partcipating institutions and 
current ED resources. 

• Standards ' - 

' ■ • ■ * * 

ED must consider two standards* error rates and error tolerances. The 
standards for error rates and tolerance vary slightly among programs, but are 

* prescribed by legislation in most of the programs reviewed. Error rates range from * 
to 5 percent. Two of the programs specify $5 error tolerance, although HHS/Medfcaid 
allows no tolerance. A review of comments submitterf in response to NPRMs and; 
published > the Federal Register suggests that rrat cr was one of the most 
sensitive issues for par^dpante in the Federal programs revie Jed. 

ED must establish error rates and tolerance that are sensitive to institutions, yet 
meaningful and responsive to the general thrust of *ED> quality control. This is 
-particularly true M these rates ^ toleraiKies are related to positive asd negative - 
incentives. A 5 - 

*■ '■ • ■ ■ ' • ■ ■ ?* • ; 

- Particularly with regard to error rates, ED may employ a transitional error rate 
structure witn declining rate targets similar to that used by HliS in the regulations 
reviewed. Substructure 

ERlCs, : 31 



reduce error rates without unduly penalizing those with high, but declining, rates. 
Error rate levels should also provide triggers for corrective action plan requirements^ 



3*2.4 Measures 

ED faces two issues related to measures: payment error and error raW 
Payment error may iiKrluae under and overawards in excesf of the prescribed 
tolerance. The concept of pay ment eiTor rnay pose signyitant methodologies 
prdbiems, particularly in the Campus-Based program, JBtfror rates typically, are 
computed as total error divided by totai payments, which seems applicable to ED QC 
regulations once payment error has been appropriately defined) 

3.2^5 Frequency of Measures * 

Although all programs considered * conducted semi-annual sampling and QC 
review, this frequency may be inappropriate for certain participating institutions. 
Many institutions award or package aid to .the majority of applicants once a year, but 
disburse .more frequently. Hence, th* ^ frequency of measurement should probably be 
tied to awarding rather than disbursement of aid. this strategy would eliminate 
'unnecessary and duplicative sampling and QC review, but would capture aU students ih 
universe from which the sample is drawn. 

, • • . . ■ y / 

3*2.6 Frequency of Reporting 

' •' •". \ - ( ' - : . , * > •. ^ " 

• •• • ■ ■ . 

One toy issue for ED is the frequency of reporting QC findings. While most . 
programs reviewed require reporting within 90 days of completion of the semi-annual 
-error measure computation, the implications of such a reporting schedule must be 
carefully scrutinized with regard to the goals of toe QC effort and the reporting 
vehicles. If Eb utilizes existing program reporting mechanisms, such reports as FeU 

^-J^0^..m^^^ reporting mechanisms. 
However, both have impHcations for the frequency of reporting and the ^institutions 
captured by, such instruments. A new instrument dedicated solely to $iich reporting 
wouW ^ to meet any desired reporting schedule and capture ail institutions, but 
may be perceived as an additional reporting burden. ' 



. / . - f r 

3.2.7 Incentives , . * ' 

- ' . ' * v « . .. 

■'.»'•' ' ' © . ' n , ' *' ■ 

Appropriate incentives are critical to the success of QC efforts. Ali programs 
reviewed used negative incentives in the form of penalties for nigh error rates. These 
penalties equaled erroneous payments above the ercor rate standard Two programs 
also used positive incentives by ' toea^ ^n^istrative cost payments for error 
rates below specif ied targets. ED could adopt a similar incentive structure, making 
the institution responsible for erroneous payments exceeding prescribed error 
standards and increasing administrative allowance, payments for bettering specified 
error rate targets. ' 

. C 

33 SUMMARY / 

\ . The preceding discussion suggests that a review of QC regulations of selected 
QC regulations provides valuable insights and options that can inform ED in 
approaching QC regulations for the Title IV program. fTnese options must be skillfully, 
altered to •meet the unique needs of ED and the distinct nature of the programs, 
educational institutions, and ultunate 
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